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Method and apparatus for processing image. 



@ This invention relates to a method and apparatus for processing an image and particularly a method 
and apparatus for providing a function of automatically judging whether an input image is a color or 
monochrome image. This invention discloses various arrangements for preventing errors in the above 
judgement 
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METHOD AND APPARATUS FOR PROCESSING IMAGE 



BACKGROUND OF THE INVENTION: 
Field of the Invention 

5 

The present Invention relates to a system such as a color copying machine, a color scanner, or a color 
facsimile machine for processing a color image and, more particularly to color/monochrome judgement of an 
input Image. 

10 Related Background Art 

A conventional color image processing system performs neither automatic judgement of a color image and 
a monochrome original nor processing based on the judgement result 

® For example, in color original copying, when a monochrome original is copied by overlapping color 
is recording agents, a black character, line, or dot cannot be obtained due to color misregistration and spectral 
and distribution characteristics of inks, resulting In poor appearance. 

® In color original communication by, e.g., a color facsimile machine, in addition to poor print quality in item 
(D described above, when three color-separated component data (e.g., R, G, and& or C, M, and Y) are 
transmitted, the transmission time is prolonged and the communication cost is increased even if the trans- 
20 mHted image is a monochrome image. 

Techniques for performing color/monochrome original judgement are disclosed in U.S. Patent No. 
4,953,012 and European Application Serial Nos. 89310091.7 and 90308100.8. 

Systems proposed by these prior-art Inventions perform chromatic/achromatic judgement using a ratio of 
three components of three primary colors (RGB or XYZ) of an input image signal. For example, if Input levels 
25 of the three primary colors have almost the same values, an achromatic color is Judged. However, when vari- 
ations in values of the three components are present, a chromatic color Is judged. Judgement of each pixel is 
repeated for all pixels of an original subjected to chromatic/achromatic judgement When the number of pixels 
representing chromatic colors exceeds a given threshold value, the original Is judged as a color original. Other- 
wise, the original is judged as a monochrome original. 
30 In the above prior art, when read precision of an image input color sensor is poor, pixels around a black 
character of an input image are often judged as chromatic pixels. For this reason, a monochrome original Is 
erroneously judged as a color original. In addition, when the original has a light under color, a judgement error 
also occurs. When an original is read in an enlargement mode, a degree of color misregistration is increased, 
and a monochrome original is more frequently misjudged as a color original. When a monochrome original with 
35 a red underline Is taken into consideration, a ratio of the number of pixels of a red line to that of aU pixels of 
the original is very low, and this monochrome original is misjudged as a color original or is properly judged as 
a monochrome image, depending on the length of the underline. 

Color/monochrome original judgement is performed by counting the number of color pixels and comparing 
this count with a given threshold value, if the count is larger than the threshold value, the original is judged as 
40 a color original. Otherwise, it is judged as a monochrome original, in this case, when an original size or a read 
magnification is changed using a threshold value as a fixed value, the number of color pixels before the change 
may be different from that after the change. Therefore, accurate original judgement may not be properly per- 
formed. 

When an original haying black characters and a light under color is taken into consideration, a user occa- 
45 sionally wishes a system to judge the original as a color or monochrome original. In this case, however, the 
user cannot reset a degree of judgement 

When a monochrome original is misjudged as a color original, the following problems are posed. 
When a monochrome original is copied by overlapping color inks (CMY) in a color copying machine, 
readability of characters, lines, and dots is degraded due to color misregistration and spectral characteristics 
so of the inks. 

In addition to poor print quality, transmission time of three primary colors is prolonged and the communi- 
cation cost is increased in a color facsimile machine although a monochrome original is transmitted. 

Although a color ruled original such as section paper and an original with a red seal are apparently color 
originals, the user wishes the color facsimile machine to intentionally judge it as a monochrome original because 
55 he frequently transmits these originals. 

The following problems are also posed. For example, when an original having a black character on colored 
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paper having a saturation distribution in a hatched portion In Fig. 42 is taken into consideration, the user wishes 
the system to judge it as a monochrome original. In addition, a color original has a low saturation In the saturation 
distribution indicated by the hatched portion in Fig. 42, the user wishes the system to judge it as a color original 
It is very difficult to judge an original having a low saturation. When the monochrome original is misjudged as 
a color original, the same problems as described above occur. 

When a monochrome original with a red underline is taken into consideration, a ratio of the number of pixels 
of a red line to that of all pixels of the original is very low, and this monochrome original is misjudged as a color 
original or is properly judged as a monochrome image, depending on the length of the underline. When the 
monochrome original is misjudged as a color original, the same problems described above occur. 

SUMMARY OF THE INVENTION: 

The present invention has been made in consideration of the above situation, and has as its object to pro- 
vide a method of processing an image, capable of accurately judging an input image as a color or monochrome 



In order to achieve the above object of the present invention, there is disclosed a method of processing 
an image, comprising the steps of converting Input color image data Into chromaticfty data and lightness data 
and performing monochrome/color judgement of the one-frame input color image data In accordance with the 
chromaticfty data and the lightness data. 

There Is also disclosed a method of processing an Image, comprising the step of performing monoc- 
hrome/color judgemant of input color image data in accordance with afteg uency distrib ution of saturation Infor- 
mation of each pixel which Is obtained from the input color image dateT 

functionr 0 ^ 05 ^ 0 ' ^ pre88nUnvent!on to P™* 0 80 ,ma 9* Processing apparatus having various editing 
comprising^ * acWeV ° 01,8 ob J ectof me ***** Invention, there is disclosed an image processing apparatus 

a) judging means for performing chromatic/achromatic judgement of an input color signal; 

b) processing means for changing an image magnfficatlon represented by the Input colorslgnal- and 

c) control means for changing a Judgement parameter of the judging means in accordance with 'the mag- 
nification. 

It is s till another object of the present invention to accurately perform monochrome/color judgement 
In order to achieve this object of the present Invention, there is disclosed an image processing apparatus 
comprising: 

means for separating an input color signal into a lightness signal and a chromaticfty signal; and 

Judging means for performing chromatic/achromatic Judgement of each predetermined area In accord- 
ance with the chromatidty signal. ««w 
There is also disclosed an image processing apparatus comprising: 

means for converting an input color signal Into a lightness signal and a chromaticfty signal; 
nal- and* 91 " 9 me8f1S perf ° miIng cnromatic/a chromatic judgement in accordance with the crtromaticity sig- 

control means for excluding a predetermined color from judgement objects. — 

^•thT^^ri 0 ^ and advanta9esofttle P"* 6 "* "™ention will be described in detail 

with reference to the following detailed description in conjunction with the accompanying drawings and the 
appended claims. 

BRIEF DESCRIPTION OF THE DRAWINGS: 

Fig. 1 is a block diagram showing an arrangement of an image processing apparatus according to the first 
embodiment of the present invention; 

Rg. 2 is a block diagram showing an arrangement of a color/monochrome judgement unit 2; 
Fig. 3 is a block diagram showing an arrangement of a color/monochrome Judgement circuit 23- 
Fig. 4 is a block diagram showing an arrangement of an image processing apparatus according to the sec- 
ond embodiment of the present invention; 

Fig. 5 is a block diagram showing an arrangement of a color/monochrome judgement circuit accordinq to 
the first embodiment of the present invention; 

Fig. 6 is a flow chart sh wing a processing flow of the first embodiment of th present invention: 
Fig. 7 is an a*b* chromatidty diagram; 

Fig. 8 is a block diagram showing an arrangement of a color/chromaticity judgement circuit according to 
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the sixth embodiment of the present invention; 

Fig. 9 is a flow chart showing a processing flow according to the sixth embodiment of the present invention; 
Figs. 10, 11A, and 1 1 B are a*b* chromatidty diagrams; 

Fig. 12 is a block diagram showing an arrangement of a color/monochrome judgement circuit according to 
5 the ninth embodiment of the present invention; 

Fig. 13 is a diagram showing a data flow Input from an image input unit; 

Fig. 14 is a block diagram of a saturation data calculation unit; 

Fig. 15 is a block diagram of a histogram calculation unit; 

Fig. 16 is a histogram table; 
10 Fig. 17 is a flow chart showing a processing flow; 

Figs. 18A to 18C are saturation histograms of the respective originals; 

Fig. 19 Is a block diagram showing an automatic color/monochrome original judgement apparatus accord- 
ing to the thirteenth embodiment of the present Invention; 
Fig. 20 is a block diagram showing a YIQ conversion unit; 
is Fig. 21 is a block diagram showing a pixel judgement unit; 

Fig. 22 is a block diagram showing an original judgement unit; 

Fig. 23 is a block diagram showing a YIQ conversion unit according to the second embodiment; 
Fig. 24 is a graph showing an l-Q distribution obtained when a monochrome original is read; 
Fig. 25 is a graph showing an l-Q distribution obtained when a color original is read; 
20 Fig. 26 is a view showing a color misregistration state; 

Fig. 27 Is a flow chart showing an overall operation in coJ or/monochrome original judgement; 
Figs. 28A and 26B are views for explaining pixel correction processing; 
Figs. 29A and 29B are views for explaining an operation for dividing an original into small areas; 
Figs. 30A and 3GB are views for explaining neighboring reference pixels; 

29 Figs. 31 A and 31 B are views showing degrees of color misregistration caused by read magnifications; 
Figs. 32A and 32B are views showing changes in size of a small area in accordance with an original size 
and an enlargement reduction magnification; 

Figs. 33A and 33B are views for explaining an operation for setting a pixel judgement threshold value a; 
Fig. 34 Is a view showing a blue distribution of section paper; 

30 Fig. 35 is a view for explaining registration of colors; 

Fig. 36 is a block diagram showing a registration color judgement unit; 

Fig. 37 is a block diagram showing an arrangement according to the fifteenth embodiment of the present 
invention; 

Fig. 38 is a block diagram showing an automatic color/monochrome original judgement apparatus accord- 
35 ing to the sixteenth embodiment of the present invention; 

Fig. 39 Is a block diagram showing an arrangement of a pixel judgement unit; 

Fig. 40 is a block diagram showing an arrangement of an original judgement unit; 

Fig. 41 is a flow chart showing an overall operation in color/monochrome original judgement; and 

Fig. 42 Is a view showing a distribution of an intermediate saturation original 

40 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS: 
(First Embodiment) 

45 Fig. 1 is a block diagram showing an overall arrangement of an Image processing apparatus according to 

the present invention. Referring to Fig. 1, the image processing apparatus Includes an image input unit 1 such 
as a scanner constituted by R, G, and B CCD line sensors, a color/monochrome judgement unit 2 for outputting 
a color/monochrome judgement signal 24 in response to an RGB input signal, and an image processing unit 
3 for performing image processing of the R, G, and B input signals In accordance with the color/monochrome 

so judgement signal 24. For example, when an input image Is judged as a monochrome image, the image pro- 
cessing unit 3 generates a monochrome or black signal from the R, G, and B signals and supplies the black 
signal together with the color/monochrome judgement signal 24 to an image transmission unit 5. The image 
transmission unit 5 serves as a facsimile transmission unit which performs predetermined encoding and trans- 
mitting a color or monochrome image. An image signal transmitted onto a public telephone line or the like Is 

55 decoded by an image reception unit 6. The decoded signal is output to an image output unit 7 such as a color 
laser beam printer, a col r ink-jet printer, or a color thermal printer. In this case, imag reproduction using black 
is performed for the monochrome image. 

Fig. 2 is a block diagram showing the color/monochrome judgement unit 2. R, G, and B Image data are 
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input from the Image Input unit 1 to an Input unit 21 , so that data are sent to a data converelon unit 22 In units 
of pixels. 

The data conversion unit 22 converts the input pixel data into X, Y, and Z tristimulus values of the CIE XYZ 
display color system, and the converted values are input to a color/monochrome judgement circuit 23. 
The color/monochrome judgement circuit 23 will be described In detail. 

Fig. 3 is a block diagram showing an arrangement of the color/monochrome judgement circuit 23. A cal- 
culation unit 1200 performs signed calculations X = X- Y, u = Y-Z, and u « Z - Y by using tristimulus values 
X, Y, and Z. Absolute values of X. u, and ° are calculated by a I nl. ' ul absolute value calculation 

unit 1201. A comparison unit 1204 selects the largest one of the fxl, and ' W ' absolute values and 
outputs a code (2-bit code in Fig. 3) representing the largest absolute value. A selector 1202 outputs a largest 
one of the differences between X, Y, and Z. A comparison unit 1203 compares the output from the selector 
1202 with a preset threshold value a. When the output from the selector 1202 exceeds the threshold value 
the comparison unit 1203 outputs a color judgement signal of the corresponding pixel. This color judgement 
signal is counted by a counter 1205. For example, if the count of the color judgement signals Is 1 , an Input image 
is judged as a color image. If the count Is a predetermined number of color judgement signals, the input image 
is not judged as a color image. In this manner, the output from the counter 1205 is compared with a threshold 
value 0 in a comparison unit 1208, thereby finally determining an original judgement signal (coJorfmonochrome 
judgement signal) 24. 

(Second Emodlment) 

Fig. 4 is a block diagram showing an arrangement obtained when the present Invention is applied to an 
Image processing apparatus operated without performing image data transmission/reception, e.g., a copying 
machine. The operations of the respective circuit components are the same as those In Fig. 1 . and a detailed 
description thereof will be omitted. 

In the above embodiment, the tristimulus values X, Y, and Z of the CIE XYZ display color system are used 
However, R, G, and B of the NTSC system, or Y, M, and C as complementary colors of R, G, and B, or other 
signals may be used in place of the above tristimulus values. 

In the above embodiment, an input image is judged as a color or monochrome image In accordance with 
the tristimulus values X, Y, and Z of the CIE XYZ display color system obtained from the Input image. That is, 
in a monochrome image, since differences between the X, Y. and Z values are relatively small, a given pixel 
of this monochrome image is judged as a monochrome pixel if a difference does not exceed the threshold value. 

A comparing means is arranged to Judging an original as a color original if a ratio (the number of color pixels) 
of color pixels to all the pixels of an Input image of this original exceeds a predetermined value, thereby judging 
a color/monochrome original. 

More specifically, by arranging the following means: 

® a means for calculating differences between tristimulus values A, B, and C representing colors as follows: 
X = A - B, n = B - C, v =C-A 

® a means for calculating the absolute values | X I , In | , and ' u ' of the differences; 

®a means for selecting the max^um value of the three absolute values |x|, |u.|,and ' u ' ; 

<S> a means for comparing the maximum value with the threshold value a and outputting the color judgement 

signal when the maximum value is larger than the threshold value; and 

® a means for counting the number of output color judgement signals, comparing the count with the 
threshold value p. and outputting the color original Judgement signal when the count exceeds the threshold 
value 0. 

Automatic color/monochrome original judgement can be performed. As a result, the following effects are 
obtained: 

©in color copying, a monochrome original can be automatically printed in only black, and print quality can 
be Improved. 

® in color facsimile transmission, since automatic switching between one-color data for a monochrome 
riginal and three- r four-color data for a color original can be performed, the transmission cost can be 
reduced, and the print quality can be improved. 
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As described above, according to the embodiments of the present Invention, color/monochrome judgement 
of an Input Image can be accurately performed. 

Fig. 7 is a view showing the principle of still another embodiment according to the present invention. An 
original te read by a color scanner, and positions of the read data In an L*a*b* uniform perceptual apace are 
5 plotted on the a*b* chromatlcity diagram. No consideration is made for L* of the plotted chromaticity points. 

For example, a color portion of the original is distributed in an area represented by hollow dots (o) in Fig. 
7, and a white paper portion and a black character are distributed in an area represented by black dots (♦). A 
threshold value a> is given. When a predetermined number of pixels having values larger (outside the dotted 
circle) than the threshold value a> are present, this original is judged as a color original. However, If only pixels 
10 having values smaller (Inside the dotted circle) than the threshold value a> are present, this original is judged 
as a monochrome original. 

The third to fifth embodiments of the present invention are arranged on the basis of the above principle. 

(Third Embodiment) 

16 

The overall arrangement and the data flow of the apparatus of this embodiment are identical to those in 
Figs. 1 and 2. 

Fig. 5 te a block diagram showing a detailed arrangement of the color/monochrome judgement circuit shown 
In Fig. 2. The color/monochrome judgement circuit includes an XYZ-hs*d* conversion unit 11. The three co- 
20 lor-separated signals obtained by reading an original by a scanner are converted into tristimutus value data X, 
Y, and Z of the CIE XYZ display color system by a data conversion unit 22. The X, Y, and Z data are Input to 
the conversion unit 1 1 and are converted into a* and b* data by the following equations. 

The a* and b* values are calculated by the following equations using the nisumulus values X, Y, and Z 
complying with Japanese Industrial standards JIS Z 8722 and JIS Z 8727: 

25 

a* » 500 [ (X/X a ) 3 

30 b* = 200((3T/K a )^ 

fox 

X/X n > 0.008856 
35 Y/Y n > 0.008856 

Z/Z n > 0.008856 



40 where a* and b* are chroma ticness indices in the L*a*b* display color system, X, Y, and Z are trlstimulus values 
of the XYZ system, and X„, Y„, and Z„ are trlstimulus values of the XYZ system on a perfect diffusion/reflection 
surface (wherein lfX/X« f Y/Y w or Z/Z„ represents a value smaller than 0.008856, a calculation Is performed by 
substituting a term of a cubic root of each equation (1) with 7.787(X0( O ) + 16/116, 7.787(Y/Y„) + 167116, or 
7.787(Z/Z„) + 16/116.) 

46 Multipliers 12 and 13 calculate square values (a*) 2 and (b*) 2 of the input signals a* and b*. respectively. 
These square values are input to an adder 14, and the adder 14 calculates (a*) 2 + (b*) 2 A sum is Input to a 
comparator 15. The comparator 15 compares the threshold value a with the sum (a*) 2 + (b*)2. |f (a*) 2 + (b*) 2 > 
a, then the comparator 1 5 outputs "1 " data. If an input pixel has a saturation value larger than a given saturation 
value, i.e., a threshold value, the output from the comparator 15 is set at "1". Otherwise, the comparator 15 

so outputs "0" data. 

When the input pixel has a saturation value larger than the threshold value, the input pixel is Judged as a 
color pixel. 

The color pixel judgement signal Is counted by e counter 16. Whether an input original is judged as a color 
original is determined by a count n of output color pixel judgement signals of level "1 For example, the input 
55 original is judged as a color original byacountof "1" or a predetermined number of output color pixel judgement 
signals. This determination is performed by properly setting the threshold value p. 

A comparator 17 compares th count n of th color pixel judg ment signals with th threshold value 0 and 
utputs a color original judgement signal wh n the count n is larger than the threshold value. 
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The threshold values a and p are properly set by a CPU (not shown). 

The above processing will be described with reference to a flow chart In Fig. 6. 

R, G, and B data are Input In units of pixels (S1) and are converted into X, Y f and Z data by the data con- 
version unit 22 (S2). The X, Y, and 2 data are then converted into a* and b* data by the XYZ-»e*b* conversion 
unit 11 (S3). A sum (a*)* + (b*) 2 is calculated by the multipliers 12 and 13 and the adder 14 and Is compared 
with the predetermined threshold value a (S4). If condition (a*)* + (b*)* > a is satisfied, the input pixel is deter- 
mined as a color pixel, and the value of the counter 1 6 is Incremented by one (S5). Otherwise, the input pixel 
is determined as a monochrome pixel. This processing is performed for all predetermined pixels (S6). When a 
count n of the counter 16 is larger than the predetermined threshold value ^, the input image is Judged as a 
color image (S8), and color signal processing is performed (S9). However, when the count n is smaller than 
the threshold value 0, the input Image is Judged as a monochrome image (S10), and monochrome signal pro- 
cessing is performed (S1 1). 

The a* and b* signals may be directly extracted from the R, G, and B signals, thereby simplifying the circuit 
arrangement 

Monochrome/color judgement need not be performed for all pixels constituting an original, but can be per- 
formed every predetermined number of pixels. 

When a pixel to be Judged as a color pixel is detected, the Judgement flow may be ended. In this case, the 
Judgement time can be shortened. 

(Fourth Embodiment) 

L # a*b* conversion is utilized to separate the image data Into the lightness signal and the chromatlclty signal 
in the third embodiment However, a conversion scheme is not limited to this. For example, image data may 
be converted into Y, I, and Q signals used In a color television system. That Is, the XYZ->a*b* conversion unit 
In Fig. 5 is replaced with an XYZ->YIQ conversion unit to perform conversion In the same arrangement as in 
the third embodiment In this case, XYZ-+YIQ conversion can be performed by the following equations: 

®CIE XY2 NTSC RGB 

R = 1.9106X - 0.5326Y - 0.28832 

G ■ -0.9843X + 1 .9984Y - 0.0283Z 

B = 0.0584X - 0.1 1 85Y + 0.8985Z 

©NTSC RGB YIQ 

Y o 0.30R + 0.59G + 0.1 1 B 

l = 0.60R-0.28G-0.32B 

Q = 0.21 R - 0.52G + 0.31 B 

However, the color components are not limited to the Y, I, and Q components, but can be replaced with. 
I*. u*, and v* components. 

(Fifth Embodiment) 

The block diagram showing an arrangement of the fifth embodiment is the same as in Fig. 5. 

The third embodiment exemplifies a color facsimfle machine for performing image-transmission. However, 
this embodiment exemplifies a copying machine which does not perform image transmission to an externa! 
device. In particular, the copying machine performs monochrome/color original Judgement by prescanning. In 
main scanning, four-color (Y, M, C, and K) or three-color (Y, M, C) print processing is performed for a color 
image, and print processing in only black is performed for a monochrome image. Therefore, the processing 
speed for a monochrome image can be increased, and color misregistration can be prevented. 

According to this embodiment, the following means are provided: 

CD a means for separating color-separated data sent from a scanner Into chromatidty information data and 
lightness information data; 

® a means for generating saturation information data from the chromaticity information data and Judging 
an input pixel as a color pixel if the saturation information data is larger than the threshold value; and 
® a means forjudging an original as a color original when a ratio of color pixels to all pixels of an input 
original Is the threshold value or more. 

Automatic color/monochrome original judgement can be performed, and the following effects can be 
obtained: 

® in color copying, a monochrome original can be automatically printed in nly black, and print quality can 
be improved. 

® in color facsimil transmission, a monochrom riglnal can be automatically transmitted in only black, 
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the cost can be reduced, and the print quality can be Improved. 

The principle of the sixth to eighth embodiments of the present Invention will be described below. 
<Principle 1> 

5 

Fig. 10 shows the principle of the sixth to eighth embodiments. 

An original is read by a color scanner, and positions of the read data In the uniform perceptual space are 
plotted In the a"b* chromaticfty diagram. No consideration is made for L* of the plotted chromaticity points. 
For example, assume that a red line is drawn on a monochrome original (black characters on white paper). 

10 Red line pixels are distributed In an area represented by hollow dots. Variations are found In data due to read 
errors and the like by an Image input means such as a scanner. A white paper portion is distributed In an area 
represented by black dots and Is Judged to include pixels having a low saturation (i.e., colorless). A black charac- 
ter of the original is distributed in a large area represented by crosses (x) in Fig. 10. Although achromatic pixels 
are distributed as pixels having colors due to the following reason. 

16 When tristlmulus data X, Y, and Z of the CIE XYZ display color system of an input pixel are achromatic, 
condition X = Y = Z must be satisfied, but variations are caused by read errors of the scanner or the like. In 
particular, an error of a color having small lightness and saturation values In a black character, a black line or 
the like is extremely larger than that of the white color In the a*b* calculation result because the X, Y, and Z 
values are small and data variations occur. 

20 In order to Judge an input original as a color or monochrome original, when a pixel located outside an area 
defined by a dotted line, Le., a threshold value © in Fig. 10 is defined as a chromatic pixel, since the red line 
pixel is located outside the area defined by the dotted line, the original having the red line is appropriately Judged 
as a color original. 

In a normal monochrome original having no red line, a black character line may be distributed outside the 
25 area indicated by the dotted line. As a result, a monochrome original may be misjudged as a color original. 

If a condition is given such that an input original Is not judged as a color original even if an image portion 
is distributed outside the area represented by the dotted line, the judgement error can be prevented. 
The following embodiments are arranged on the basis of the above principle. 

30 (Sixth Embodiment) 

The block diagram showing the overall arrangement of the image processing apparatus of this embodiment 
and a data flow are shown as In Rgs. 1 and 2, respectively. 

Fig. 8 is a block diagram showing a detailed arrangement of the color/monochrome Judgement circuit in 
35 Fig. 2. The color/monochrome judgement circuit includes an XYZ-+L*a*b* conversion unit 311. Three color- 
separated signals obtained by reading an original by a scanner are converted into tristlmulus value data X, Y, 
and Z of the CIE XYZ display color system by a data conversion unit 322. The X. Y, and Z data are input to 
the data conversion unit 311 and are converted into L*, a*, and b* data in accordance with the following equ- 
ations. 

40 The L", a*, and b* values are calculated by the following equations using the tristlmulus values X, Y, and 

Z complying with the JIS Z 8722 and JIS Z 8727 standards. 
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L* = 116 * - 16 



for 

Y/Y a > 0,008856 



(1) 



(2) 



a* = sooEU/jg » - (r/yj"*] 

.for 

JT/J^ > 0.008856 

i>* « aootcr/rj^ - iz/zj^i 
for 

y/Y a > 0.008856 
Z/Z n > 0,008856 



where a* and b* are chromaticness Indices In the L*a*b* display color system, X, Y, and 2 are tristimulus values 
of the XYZ system, and X„ f Y n , and Z; are tristimulus values of the XYZ system on a perfect diffusion/reflection 
surface (wherein if Y/Y n is 0.008858 or less, L* is obtained by the following equation- 
L* = 903.290^ 

and ffX/X,,, Y/Y nt orZ^, represents a value smaller than 0.008856, a calculation is performed by substitute 
a term of a cubic root of each equation (1) with 

7.787(X*X n ) + 16/116, 

7.7870^*) +16/116. or 

7.787(Z/Z„)+ 16/116.) 

Multipliers 312 and 313 calculate square values (a-)* and (b-p of the input signals a* and b\ respectively 
These square values are Input to an adder 314, and the adder 314 calculates (a*)* + (b*p. A sum Is Input to a 
comparator 315. The comparator 15 compares the threshold value a with the sum (a")* ♦ (b*)* If (a*)* ♦ (b*) 2 
>ct, then the comparator 31 5 outputs "1-data. If an input pixel has a saturation value larger than a given satu- 
ration value, i.e., a threshold value, the output from the comparator 31 5 Is set at "1". Otherwise, the comparator 
315 outputs "0- data. The lightness data L* output from the XYZ-LMV conversion unit 31 1 is input to a com- 
parator 316. The comparator 316 compares the lightness data L* with a threshold value p. If condition L* > 8 
is established, the comparator 316 outputs "1" data. If the input pixel has a lightness value larger than a 
threshold value, the comparator 316 outputs "1" data. Otherwise, it outputs "0* data. 

An AND gate 317 calculates a logical product of the data from the comparators 315 and 316 and outputs 
a color/monochrome judgement signal. That is, when a pixel has large saturation and lightness values, this 
pixel is judged as a color pixel. 

A color pixel Judgement signal is counted by a counter 31 8. Whether an input original Is judged as a color 
original is determined by a count n of output color pixel judgement signals of level "1". For example, the input 
original is Judged as a color original by a count of "1" or a predetermined number of output color pixel judgement 
signals. This determination is performed by properly setting the threshold value y. 

A comparator 319 compares the count n of the color pixel judgement signals with the threshold value y and 
outputs a color original judgement signal when the count n is larger than the threshold value. 

The threshold values a, p, and y are properly set by a CPU (not shown). 

The above processing wHI be described with reference to a flow chart in Rg. 9. 

R. G, and B date are input in units of pixels (S301) and are converted into X, Y. and 2 data by the data 
conversion unit 322 (S302). The X, Y, and 2 data are then converted Into L* f a*, and b* data by the XY2-*L*a*b* 
conversion unit 31 1 (S303). A sum (a*)z + (b*)* is calculated by the multipliers 312 and 313 and th adder 314 
and is compared with the predetermined thresh Id valu a (S304-1). If condition (a*)* + (b*)2 > tt fe satisfied 
it is judged whether condition L* > p is satisfied (S304-2). If condition L*> 0 is satisfied, th Input pixel is deter- 
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mined as a color pixel, and the value of the counter 318 is incremented by one (S305). Otherwise, the input 
pixel is determined as a monochrome pixel. This processing is performed for all predetermined pixels (S306). 
When a count n of the counter 31 8 Is larger than the predetermined threshold value 0 (S307), the Input image 
is judged as a color image (S308), and color signal processing is performed (S309). However, when the count 
6 n Is smaller than the threshold value 0, the input image is judged as a monochrome image (S31 0), and mono- 
chrome signal processing is performed (S31 1). 

The f, a*, and b* signals may be directly extracted from the R, G, and B signals, thereby simplifying the 
circuit arrangement. 

Monochrome/color judgement need not be performed for all pixels constituting an original, but can be per- 
10 formed every predetermined number of pixels. 

When a pixel to be judged as a color pixel is detected, the judgement flow may be ended. In this case, the 
judgement time can be shortened. 

(Seventh Embodiment) 

15 

L*a*b* conversion is utilized to separate the image data Into the lightness signal and the chromaticity signal 
in the sixth embodiment However, a conversion scheme is not limited to this. For example, image data may 
be converted Into Y. i. and Q signals used In a color television system. That is, the XYZ-+L*8"b" conversion 
unit in Fig. 8 is replaced with an XYZ-VYIQ conversion unit to perform conversion in the same arrangement as 
20 in the sixth embodiment In this case, XYZ-tYIQ conversion can be performed by the following equations: 

(DCIE XYZ -» NTSC RGB 

R o 1.9106X - 0.S326Y - 0.2883Z 

G - -0.9843X + 1.9984Y - 0.0283Z 

B = 0.0584X -0.1185Y + 0.8985Z 
25 ® NTSC RGB -*YIQ 

Y « 0.30R ♦ 0.59G + 0.11B 

I - 0.60R - 0.28G - 0.32B 

Q = 0.21R - 0.52G + 0.31B 

However, the color components are not limited to the Y, I, and Q components, but can be replaced with 
30 L* t u*. and v* components. 

(Eighth Embodiment) 

The sixth embodiment exemplifies a color facsimile machine for performing image transmission. However, 
35 the eigth embodiment exemplifies a copying machine which does not perform image transmission to an external 
device. In particular, the copying machine performs monochrome/color original judgement by prescanning. in 
main scanning, four-color (Y, M, C, and K) or three-color (Y, W, C) print processing is performed for a color 
image, and print processing In only black is performed for a monochrome image. Therefore, the processing 
speed for e monochrome image can be Increased, and color misregistration can be prevented. 
40 According to the sixth to eighth embodiments described above, the following circuits are provided: 

<J)a circuit for separating color-separated data sent from a scanner Into chromaticity Information data and 
lightness information data; 

® a circuit for generating saturation information data from the chromaticity information data and judging an 
Input pixel as a color pixel if the saturation information data is larger than the threshold value; 
46 <3)a circuit for judging that a pixel has a large lightness value when the lightness information data is larger 
than a threshold value; 

® a circuit forjudging from the above judging circuits that a pixel is a color pixel; and 
® a circuit for judging an original as a color original when a ratio of color pixels to ail pixels of this original 
is the threshold value or more. 
so Automatic color/monochrome original judgement precision can be improved. 

<Principle 2> 

In the principle 1 described above, judgement is performed by also considering the lightness information. 
55 However, when the saturation threshold value is changed as indicated by reference numerals 41, 42, and 43 
In the a*b* chromaticity diagram f Fig. 11 B in accordance with the lightness, the judgement errors described 
above can be prevented. That is, when th lightness value is small, a thresh Id value co in the a*b* chromaticity 
diagram of Fig. 1 1A is decreased. Otherwise, the threshold valu o> is increased to perform optimal judgement 
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The ninth embodiment is arranged on the basis of the above principle. 
(Ninth Embodiment) 

Most of the part of this embodiment is the same as that of the sixth embodiment However, as shown in 

by an LUT 320 to solve the above problem. 

In this embodiment, table look-up operation is performed In the LUT 320 in accordance with the L* value 
For example, when the value f is small, a larger threshold value a Is used. However, when L* is large, a is' 
set to be a small value. Misjudgement as a "high saturation" for a black character or the like can be prevented 
m ^ , S ^?? ca,, y' when ^stimulus values are input to an XYZ-+LW conversion unit 311. a saturation 
data value 120 is output from an adder 314. Assume that an L* value is 20. In this case, the LUT 320 outputs 
a value 150 predetermined in response to input data "20". A saturation threshold value is increased for data 
having a relatively small lightness value as L* = "20". A comparator 315 compares data "120" output from the 

^Z 1 *! 150 " ° utput me LUT s,nce me saturation data is smaller than the threshold value, 
an output from the comparator 315 Is set at "0V In this case, a counter 317 Is not operated 

Assume that a saturation data value "80" Is output from the adder 314 and that an L* value is -80-. In this 
case, the LUT 320 outputs "50". 

mSSSSSl m t?I™- a]mS * deCfeaS,n9 th8 MtUrati0n thre8hoW "Hue fordatahavtaga roiaHvely 

^1™"?™^ 315 " Jm P arB ! d8ta " 80 " and " 50 " ou, P utfrom adder 314 and the LUT 320. Since the 
saturation data is larger than the threshold value, an output from the comparator 31 5 Is set at *1". so that the 
counter 317 counts this output 

« thr88h< i d vaIue te 8at 88 p s 100 and a count counter 317 reaches 101. i.e., the number of 

times of judgement of target pixels as color pixels is 101. the comparator318 outputs a color original Judgement 
; signal, and the read original is judged as a color original. 

In this embodiment L*a*b* conversion is used to separate the image data Into the lightness and chromatt- 
citystonals. However, the conversion scheme is not limited to this. For example, the image data may be con- 
verted into Y, I, and Q signals of a color television system as in the seventh embodiment 

The ninth embodiment may be arranged as in the eighth embodiment 

In this embodiment a table as an LUT (Look-Up Table) is used to determine the threshold value cu How- 
ever, the threshold value a may be operated as a function of L* by using an operation circuit 
According to the ninth embodiment there are provided the following circuits: 

» ^ rCUf !^ f ^P 813 * 1 * color-separated data sent from a scanner into chromaticfly Information data and 
lightness information data; 

® a circuit for generating saturation information data from the chromaticity information data and judges that 
a target pixel Is a color pixel when the saturation information data is larger than a given threshold value; 
U a circuit for changing the threshold value in accordance with the lightness information data; and 
<® a circuit forjudging a target original as a color original when a ratio of the number of color pixels to that 
of all pixels exceeds a given threshold value. 

With the above arrangement color/monochrome original Judgement precision carrDe improved 
n particular, according to the present invention, judgement precision can be greatly improved because both 
pixels Infonmat,on and me chromaticity information are used in monochrome/color Judgement in units of 

Automatic color/monochrome original judgement can be performed, and the following effects can be 
obtained: 

CD incolor copying, a monochrome original can be automatically printed in only black, and print quality can 
os improved. 

® in color facsimile transmission, a monochrome original can be automatically transmitted in only Wack. 

me cost can be reduced, and me print Quality can be Improved. 

The third principle of the following embodiments wiil be described below. 

<Principle 3> 

When an riginal is read by a scanner or the like, frequency distributions of the aturation values of the 
respective pixels are shown in Figs. 18A.18B, and 18C. 

Fig. 18A sh ws the frequency distributl n of a monochrome original which is achromatic Ail the pixels must 
be distributed in the range of aturati nO.H wever.th actual distribution is spread due to read errors of the 
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scanner or the like, as shown in Fig. 18A. 

Fig. 18B shows the frequency distribution of a color original which includes pixels from a pixel having a 
low saturation to a pixel having a high saturation, thus obtaining a uniform distribution. 

Fig. 18C shows the frequency distribution of a light color original having a black character, a black line, 
5 and the like. This original is to be judged as a monochrome original. An under color of the sheet tends to be 
distributed In a wider area than that of the black character and line, shown in Fig. 18C. 

When a saturation histogram is plotted, a maximum peak Is present In a range having a relatively high satu- 
ration. Whan the frequency of the peaks exceeds a predetermined value and another peak is present at the 
saturation "0", this original is judged as a monochrome original (with colored paper). In practice, the target origf- 
10 nal Is judged as a monochrome original: 

® when the maximum saturation peak falls within the range between a threshold value S 0 and a threshold 
value S<t; and 

<2> when the second peak is a threshold value S2 or less. 

When paper having a light color as an under color of the original is used, an original to be judged as a mono- 

19 chrome original is not judged as a color original on the basis of this principle. 

(Tenth Embodiment) 

The block diagram showing the overall arrangement of an image processing apparatus of this embodiment 

20 is the same as that in Fig. 1. 

Fig. 13 Is a view showing a data flow. 

Data is input from an image input unit 1 to an input unit 421 and is sent to a data conversion unit 422 in 
units of pixels. The pixel data input to the data conversion unit 422 are converted into tristfmuius values X, Y, 
and Z represented by the CIE XYZ display color system, and the tristfmuius values X, Y, and Z are input to a 
25 color/monochrome judgement circuit 423. 

Saturation data Is input to a histogram calculation unit 424, and a frequency distribution of the saturation 
data is calculated. 

Fig. 14 is an XYZ-*a*b* conversion unit 411 which converts the input data into a* and b* data. 
The a* and b* values are calculated in accordance with the tristfmuius values X, Y, and Z complying with 
so the JIS Z 8722 and JIS Z 8727 standards as follows: 



X JL 

a* = 500[(X/X n ) 3 - (Y/YJ 3 ] 
35 for 

X/X a > 0.008856 

40 2>* = 200 [ (Y/Y n ) - (Z/Z n ) "*] 

for 

Y/Y n > 0.008856 
45 Z/Z a > 0.008856 

where a* and b* are chromaticness indices in the L*a*b* display color system, X, Y, and Z are tristfmuius values 
of the XYZ system, and X„, Y n , and Zn are tristimutus values of the XYZ system on a perfect diffusion/reflection 
so surface (wherein if X/X„, Y/Y n , or Z/Z„ represents a value smaller than 0.008856, a calculation is performed by 
substituting a term of a cubic root of each equation (1 ) with 

7.787(X/X fl ) + 16/116, 

7.787(Y7Y„)+ 16/116, or 

7.787(Z/Zy + 16/116.) 

55 Multipliers 41 2 and 41 3 calculate square values (a*) 2 and (b*) 2 of the Input signals a* and b*. respectively. 

These square values are input to an adder 414, and the adder 414 calculates (a*) 2 + (b*) 2 A sum is input to a 
saturation normalization unit 415 and is normalized into 8-bit data representing any one f 0 to 255 values. In 
this manner, the saturation data is calculated. 



•••(I) 
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The saturation data (8 bits) Is sent to the histogram calculation unit 424 (to be described In detail with refer- 
ence to Fig. 1 5). A saturation signal passing through a selector 431 serves as an address signal for a RAM 
432. That is, a histogram table in Rg. 16 is constituted by a RAM. The saturation signal as the address signal 
of this RAM to look up the histogram table. Data addressed in the RAM appears on a data One in synchronism 
with a dock CLK 435. The data read out from the RAM is added by one in an adder 433. The sum data from 
the adder 433 is temporarily stored In a buffer 434. When the level of the sync signal CLK 436 Is changed, the 
RAM 432 is set In a write enable state, and the buffer 435 is set In an output enable state. The data stored In 
the buffer 435 is output onto the data line and written in the RAM 432. The frequency table is updated every 
time saturation data representing one of the values 0 to 255 is input to the histogram calculation unit 424. 

When ail pixels of the original are read, a frequency histogram associated with the saturation data is stored 
in the RAM 43Z 

The RAM 432 Is addressed from a CPU (not shown) to read out data. The CPU Judges whether a maximum 
value M of the frequency of the histogram is larger than a predetermined value Ho and whether the correspond- 
ing saturation value S fens within the range between the threshold value So and the threshold value S 1f as shown 
in Fig. 18C or whether the saturation value S is smaller than the threshold value S* as shown In Fig. 18A. If 
the above conditions are satisfied, the CPU judges the Input original as a monochrome original. 

If the CPU Judges that the maximum value M of the frequency of the histogram is smarter than the pre- 
determined value Ho or that the corresponding saturation value S fens within the range between the threshold 
value S 2 and the threshold value So or is larger than the threshold value S 1t as shown In Fig. 18B, a signal 
representing a color original is output In this manner, even if paper has a light color, the corresponding original 
can be accurately judged as a monochrome original. 

The above processing sequence will be described with reference to a flow chart In Fig. 17. 

R, G, and B data are input in unite of pixels (S401) and are converted into a* and b* data by the XYZ-+a*b* 
conversion unit 41 1 (S403). A sum (a*)* + (b*)* is calculated by the multipliers 412 and 413 and the adder 414, 
and normalization of the sum is performed (S404). A frequency is then counted (S405). This processing is per- 
formed for all predetermined pixels (S406), and a maximum frequency M and a corresponding saturation value 
S are detected (S407). The values M and S are determined whether to be predetermined values (S408). If con- 
ditions are satisfied, the input image is judged as a monochrome image (S409), and monochrome image pro- 
cessing Is performed (S410). However, when the input image is judged as a color image (S411), color image 
processing is performed (S412). 

As described above, according to this embodiment, by providing the following means: 

® a means for separating color-separated data sent from the scanner into chromatidty information data 

and the lightness information data; 

® a means for generating saturation information data from the chrominance information data; 
® a means for normalizing the saturation information data; 

<3>a means for calculating a frequency distribution of the data obtained by the means® ; and 
® a means for comparing saturation data having a largest frequency value with the threshold value, 
an original having a certain under color or having paper with a light color can be accurately judged as a 
monochrome original. As a result, the following effects can be obtained: 

CD in color copying, a monochrome original can be automatically printed In only black, and print quality can 
be improved; and — 
® in color facsimile transmission, since a monochrome original can be automatically transmitted in only 
black, the transmission cost can be reduced and the print quality can be improved. 
The a* and b* signals may be directly extracted from the R, G, and B signals, thereby simplifying the circuit 
arrangement Monochrome/color judgement need not be performed for an pixels constituting an original, but 
can be performed every predetermined number of pixels. 

In addition to the condition as the maximum frequency, a condition that the second peak is smaller than 
the threshold value Sz may be added to perform judgement to improve judgement precision. 

Formation of a saturation histogram Is not limited to the specific one described in the above embodiment 
For example, all processing operations can be performed by computer software. 

(Eleventh Embodiment) 

L*a*b* conversion is utilized to separate the image data into the lightness signal and the chromaticity algnal 
in the tenth embodiment However, a conversion scheme is not limited to this. For example, image data may 
be converted into Y, I, and Q signals used in a col r television system. That is, the XYZ-+L*a*b* conversion 
unit in Rg. 14 is replaced with an XYZ-+YIQ conversion unit to perform conversion in th same arrangem nt 
as in the tenth embodiment In this case, XYZ-+YIQ conversi n can be performed by the following equations: 
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<3)CIEXYZ-*NTSCRGB 
R - 1.9106X - 0.5326Y - 0.28832 
G = -0.9843X + 1.9984Y - 0.0283Z 
B » 0.0584X - 0.1 185Y + 0.8985Z 
5 ©NTSCRGB-+YIQ 

Y = O.30R + 0.59G + 0.11B 
| = 0.60R-OJ28G-0.32B 
Q = 0.21R-0.52G + 0.31B 

However, the color components are not limited to the Y, I, and Q components, but can be replaced with 
10 L\ u*, and v* components. 

(Twelfth Embodiment) 

Fig. 8 Is a block diagram showing an arrangement of the twelfth embodiment The tenth embodiment exerrv 
is pllfies a color facsimile machine for performing image transmission. However, this embodiment exemplifies a 
copying machine which does not perform image transmission to an external device. In particular, the copying 
machine performs monochrome/color original judgement by prescanning. In main scanning, four-color (Y , M, 
C, and K) or three-color (Y, M, C) print processing is performed for a color image, and print processing in only 
black Is performed for a monochrome image. Therefore, the processing speed for a monochrome Image can 
20 be increased, and color misregistration can be prevented. 

<Princlple4> 

An original is read by a color scanner, and the read data are converted into R, G, and G data of the NTSC 
25 system. The R, G, and B data are converted Into lightness data Y and chromatlcity data I and Q. The data I 
and Q are plotted as shown in Figs. 24 and 25. 

Fig. 24 shows the data I and Q of a monochrome original, and Fig. 25 shows the data I and Q of a color 
original. When the monochrome original is read, the data I and Q are distributed near the origin. However, in 
the color original, the data I and Q are plotted away from the original. When the number of pixels away from 
30 the origin is large, this input original is judged as a color original. Otherwise, the input original Is judged as a 
monochrome original. Originals are judged on the basis of this principle. 

(Read Precision of Scanner) 

35 When a monochrome character Is read by a scanner, and the scanner has poor read precision, the resultant 
input image has color misregistration, as shown in Fig. 26. A color misregistration pixel Is Judged as a color 
pixel, and an original is misjudged as a color original although this original Is a monochrome original. For this 
reason, if a black pixel (a monochrome and dark pixel) is present around an input pixel, the input pixel is a color 
misregistration pixel. Therefore, this input pixel is judged as an actual monochrome pixel. With this operation, 

40 a read error of the scanner can be reduced. When an original is to be read In an enlargement mode, a color 
misregistration area is increased as shown in Fig. 31 B as compared with a real size mode In Fig. 31 A, and a 
black pixel away from the pixel of interest must be found. As shown in Fig. 30, in the real size mode, as shown 
In Fig. 31 A, eight pixels (pixels of the hatched area) around the pixel of interest C are used to Judge whether 
a black pixel is present In an enlargement mode, as shown In Fig. 30B, eight pixels of the hatched area around 

45 the pixel of interest are used to judge whether a black pixel is present In this manner, reference pixels around 
the pixel of Interest are changed in accordance with the magnification coefficients, thereby performing accurate 
judgement 

(Original Judgement Precision) 

so 

When a monochrome original having a red underline is to be judged, since the number of red pixels to that 
of all pixels of the original is large, a 50-mm line becomes similar to a 0.5-mm line. Judgement errors may occur 
due to different threshold values. More specifically, an original having a 50-mm red underline is Judged as a 
monochrome original, or an original having dust having a diameter of about 0.5 mm is Judged as a color original. 
65 In order to maximize a ratio of the number of color pixels (red underline) to that of all pixels of the original, a 
technlqu in Figs. 29A and 29B is used. More specifically, an original 1101 shown In Fig. 29A is divided into a 
plurality of small areas, and the original is judged in units f small areas. Assume that area 1 of 1 102 and area 
2 f 1 103 are Judged as monochrome original areas, and that area 3 of 1 1 04 is judged as a col r original area. 
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l£2^VV? j H d9ed 88 8 G0, ° r ori9inaK Un,ess a °y 8013,1 judged as a color original area the 
original 1 101 Is judged as a monochrome original °ngmai area, tne 

Is set bv Iras than o 1* J Z^TJkLTv ^ . , <* the 8ma " ama . and a monochrome original area 
*Z^J£J£2£Z^S&i 5L" - ") ?"—»•»«- RSH eZ 
color pixel threshold value 8 iTZ H^,' 8 " ° 1% 0fmetoW P^' «««* Is defined as the 

(Thirteenth Embodiment) 

A flow chart of this processing Is shown in Fig. 27. The processino la dh/M<wi tm» „, 
cessing (S517 and S518). pixel Judgement processing (SWI^S oiJ2^1^ W ^ 8< T fl Pr °" 
S51 1). and original Judgement processing ^^^^o^^^^^T^ S* 5 ^ 
Judging whether a pixel of interest is a color or ™Z^hrrLl ^ p .^ jud 0emerit processing is processing for 
cessfng for Judging whe^T^a?! a w^^iTT^t ^„°^ V™"** b P™" 

algorimm wO. be dLribed with reZnt to me^cnart monochrome «** The details of the 

<Parameter Setting Processfng> 

An original size and a copying magnification are designated at the operation unit fSSlTi a opi i 
judgement parameter in a manner to be described later (S518). (S517) - A CPU 8ete a 

<Ptxel Judgement Processing> 
® Color Space Conversion Processing 
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©Distance Calculation 



•norder to generate saturation information from the la nd Q data, a distance calculation unit calculates 
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©Saturation Comparison Unit 

The saturation value of the pixel of interest is compared with the threshold value In step S503. As shown 
in Fig. 28A, the pixel C of interest is part of a character or an under color portion (limited to white), it has a low 
5 saturation level. The flow advances to step S504 to satisfy condition 

T? + Q 2 < a, 

and a black pixel count BPLX is incremented by one. The flow returns to step S502, and the next pixel is read 
w to repeat the above processing. 

When the pixel of interest is assumed to be located as a color pixel, as shown in Fig. 28B, it has a high 
saturation level, and the flow advan ces to step S 50S without satisfying condition 

Vl 2 + Q z < a. 

15 

(D Pixel Correction Processing 

Steps S505 to S51 1 correspond to the pixel correction processing unit These steps are provided to correct 
a Judgement error as a color pixel due to blurring of a black character caused by color misregistration of the 
20 sensor even if the saturation comparison unit corresponding to step S503 judges that the input pixel is a color 
pixel. The pixel correction unit wfli be described below. 

in step S505, eight neighboring pixels S, to Sa of the pixel C of interest in Fig. 5 are input one by one. In 
step S506, RGB-VY1Q conversion is performed by color space conversion (the same as In steps $501). 

Saturation information 

/I* + Q* 

is calculated in stop S507 (the same as in step s S5Q2). Sa turation values 

/FT? 

30 

of the neighboring pixels and the luminance Y are compared with the threshold values in step S508. For 
example, when the neighboring pixel S, is a character portion, the saturation and luminance values of this pixel 
are low, it satisfies conditions 

35 Vl 2 + Q 2 < 3 

and Y < y. As a result, although the pixel C is Judged as a color pixel in pixel Judgement processing, this mis- 
judgement is caused by color misregistration of the sensor. This pixel must be judged as a black pixel, and the 
40 flow advances to step S509. The black pixel count BPLX is incremented by one. Since the neighboring pixel 
Se does not satisfy conditions 

i I 2 + q 2 < 0 

45 and Y < y, the pixel Se is determined not to be a black pixel. In this case, the flow advances to step S51 0. It is 
judged in step S510 whether all the eight neighboring pixels are Input Processing in steps S505 to S510 to 
judge whether a black pixel is included in the eight neighboring pixels is repeated for all the eight pixels in S501 
to $508 of the pixel of interest if at least one black pixel is Included in the eight neighboring pixels, the pixel 
C of interest is judged as a black pixel, end the flow advances to step S509. If no black pixel is included in the 

so eight neighboring pixels, the pixel C of interest Is not judged as a color pixel by color misregistration, but is a 
real color pixel. In this case, the flow advances to step S511, and the color pixel count CPLX is incremented 
by one. 

<Color/Monochrome Original Judgement 

65 

The pixel judgement (S501 to S511) described above is performed for all the pix Is of the original to cal- 
culate a ratio f the col r pixel count CPLX to the monochrome pixel count BPLX When condition CPLX > 6 
is satisfied in step S513, the target original is judged as a color original. Otherwise, the target original is judged 
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as a monochrome original. This area judgement is performed for all small areas of the original. If at least one 
small area which is judged as a color area, the original as a whole is judged as a color original; otherwise, the 
original is judged as a monochrome original (S516). 

The above flow chart shows processing executed by computer software. A circuit arrangement for perform- 
ing the above processing will be described. 

Referring to Fig. 19, when an original is placed on a scanner 101 consisting of a CCD device and scanned, 
normalized R, G, and B data complying with the NTSC system are output R, G, and B data output from the 
scanner101 are converted by a YIQ conversion unit 1 02 into a lightness (luminance) signal Y and (chromaticity) 
chrominance signals I and a A pixel judgement unit 103 judges whether an Input pixel Is a monochrome (small 
saturation value) or color pixel. An original judgement unit 104 accumulates the Judgement results In units of 
pixels and calculates a ratio of the number of color pixels to the total number of pixels. The original judgement 
unit 104 outputs an original judgement signal 105 representing that the original is a color or monochrome origi- 
nal in accordance with the calculated ratio. This circuit arrangement also includes an image processing unit 
106 for outputting an image reproduction signal having a magnification input from an operation unit 110, a dis- 
play 1 07 for performing an Image display, a facsimile transmission unit 1 08 for performing image transmission, 
and a printer 1 09 for reproducing an image on a recording medium. The operation unit 1 1 0 is used to manually 
designate an original size and a copying magnification. A CPU 1 1 1 judges a pixel in accordance with the original 
size and the copying magnification designated at the operation unit 110, determines an original judgement par- 
ameter, and outputs a parameter signal 353, DAT1 , and DAT2. 

The image processing unit 108 performs different processing operations for the monochrome and color 
originals in accordance with the original judgement signal 105. 

For example, an Image signal sent to the facsimile transmission unit 108 is subjected to compression coding 
so as to store It In the form of R, G, and B signals for a color original, and is subjected to density (luminance) 
signal conversion to perform compression coding such as MH, MR, or MMR coding for a monochrome original. 

When an image signal of a color original is to be sent to the printer 109, predetermined processing oper- 
ations such as logarithmic conversion, UCR, and masking are performed for the R, G, and B signals, thereby 
performing image processing to obtain frame sequential Y, M, C, and K signals and then performing monoc- 
hrome processing. However, an Image signal of a monochrome original is processed to obtain only a K (black) 
signal, thereby performing printing in only black. 

The printer may be a color printer such as a laser beam printer, an Ink-Jet printer, a thermal printer, or a 
dot printer. 

Fig. 20 is a block diagram showing the YIQ conversion unit for calculating values of equations (1). The YIQ 
conversion unit receives R, G, and B input signals 201, 202, and 203. The YIQ conversion unit also Includes 
reglstere 204 to212fbrstoring coeffiderte of ^ 

of equations (1) with the coefficients, adders 222, 223, 225, and 228, and subtracters 226 and 229. Operation 
results of Y f I, and Q are output to 224, 227, and 230. respectively. 

For example, in orderto calculate Y, 0.3, 0.59, and 0.11 are respectively set In the registers 204. 207, and 
210. The R data 201 and the content of the register 204 are multiplied by the multiplier 213. Similarly, the G 
data and the content of the register 207 are multiplied by the multiplier 21 6, and the B date and the content of 
the register 210 are multiplied by the multiplier 219. Three products are added by the adders 222 and 223 to 
finally obtain data Y. Data I and Q can also be obtained in the same manner as described above. 

Fig. 21 is a view showing the pixel judgement unit Y, I, and Q data are input to Input terminals 301 , 302, 
and 303, respectively. The data I is squared by a multiplier 360, and the data Q is also squared by a multiplier 
361. The products I 2 and Q 2 from the multiplier s 360 and 3 61 are added by an adder 362. A calculation of 

Vl 2 + Q 2 

is performed with reference to a table. For example, an Input to a ROM 363 is "2", the second address of the 
ROM Is accessed, and the corresponding date "1.1414" is output The output value 



from the ROM 363 is input to comparators 305 and 306. A threshold value p is set in a register 308, and the 
threshold value a is set in a register 309. The comparator 305 compares the threshold value p with 

^I 2 + Q 2 

and outputs "1 " date if condition p < 
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Vl* + Q 2 . 

Otherwise, the comparator 305 outputs "0" data. An output result of the comparators 306 Is called a primary 
Judgement result 

s As for the lightness (luminance) signal, a threshold value y is set In a register 307, and a comparator 304 

compares Y with y. ff Y < y, then the comparator 304 outputs "1" data. Otherwise, the comparator 304 outputs 
"0" data. Outputs from the comparators 304 and 305 are logically ANDed by an AND gate 364. More specifically, 
when a lightness (luminance) is low, and saturation is also low, the AND gate 364 outputs "1 " data Otherwise, 
the AND gate 364 outputs "0" data. An output result of the AND gate 364 Is called a secondary judgement result 

10 The output from the AND gate 364 is input to a flip-flop (to be referred to as an FF hereinafter) 369 and a line 
memory 365. 

An output from the line memory 365 is input to a line memory 368 and an FF 325. A pixel delayed by one 
line is input to the FF 325 and a pixel delayed by two lines is input to an FF 329. Similarly, pixels are supplied 
to line memories 367 and 368, so that a pixel delayed by three lines is stored in an FF 334 and a pixel delayed 

IB by four lines Is stored In an FF 338. In this manner, the FFs 320 to 342 store output results from the AND gate 
364 In synchronism with pixel docks. At a given moment when the secondary judgement result of the pixel of 
interest is stored in the FF 331 , the secondary Judgement results of the 22 neighboring pixels are stored in the 
FFe 320 to 342 (except for the FF 331). An output (primary judgement result) from the comparator 306 is Input 
to a line memory 343, and an output from the line memory 343 is Input to a line memory 344. An output from 

20 the line memory 344 is input to FFs 345, 346, and 347. The FFs 31 1 and 347 store the primary and secondary 
judgement results of the same pixel, respectively. A total of nine signals as the primary Judgement results of 
the neighboring pixels indicated by the hatched pixels In Fig. 29B and the primary judgement result of the pixel 
of interest are supplied onto a signal line 348. A total of nine signals as the secondary judgement results of the 
hatched pixels in Fig. 29A and the primary judgement result of the pixel of Interest are supplied onto a signal 

25 line 349. A selector 350 selects one of these signal tines In response to a selection signal SEL (353). The selec- 
tion signal 353 output from the CPU 111 in response to a magnification designated at the operation unit 110 
selects the signal line 349 when the read magnification is small, and correction is performed using a matrix 
shown In Fig. 30A. However, when the magnification is large, the signal line 348 is selected, and correction 
using a matrix in Fig. 30B is performed. An output from the selector 350 is input to a NOR gate 351. The NOR 

30 gate 351 has nine Inputs and one output When any one of the primary and secondary judgement results is 
set to be "1", the input pixel is judged as a color pixel, so that a color pixel judgement signal 352 is output as 
a "1" signal. That Is, when the pixel of Interest la judged as a color pixel, the color pixel Judgement signal 352 
Is set at logic "1". Otherwise, the pixel of interest is judged as a monochrome pixel, and the signal 352 is set 
at logic TT. 

35 A plurality of parameters can be set in the registers 307, 308. and 309, and Judgement parameters y, p. 

and a can be selectively used. More specifically, when a magnification is large, a possibility of color misregis- 
tration is high. Larger parameters y 2 , fa, and cfe than parameters y 1f ft, and a t (72 > 7* fe > Pi* «2 > «i) are 
selected. 

Fig. 22 is a block diagram of an original judgement unit Since a count enable terminal 1408 of an up-counter 

40 1407 is set at "0" (enabled), the up-counter 1407 counts up initial count data DAT2 (1404) in synchronism with 
a pixel clock 1402. When a carry CARRY2 (1409) is set at "1 ", the up-counter 1407 i&ceset and restarts counting 
from the Initial count data. The up-counter 1407 counts pixels of the smalt area of the original. For example, 
when the number of pixels of the small area 1102 is 1,000, the up-counter 1407 counts 1,000 pixels. When 
1,000 pixels are counted, the carry 1409 is set at "1", and an up-counter 1408 is reset The initial count data 

46 Is set such that, if the up-counter 1407 is a 10-bit counter, when the initial count data 24 is set in the DAT2, 
1 ,000 pixel dock pulses 1402 are counted to set the cany CARRY2 (1409) to "1". 

The up-counter 1406 receives the initial count data DAT1 at Its input 1403, a pixel clock at its input 1402, 
and a color pbcel judgement signal at its input 1401, and outputs a carry bit 1410. The counter 1408 performs 
count-up operation from the Initial count data. During a count-up enable period, the color pbcel judgement signal 

so is counted during the "1" period of the color pbcel judgement signal. As a result, the color pixel judgement signals 
are counted. For example, if the counter 1406 Is a 10-bit counter and the original judgment threshold value (color 
pixel threshold value) 6 is 255, 769 is set in the DAT. When the number of pixels judged as color pixels becomes 
255, the cany bit 1407 is set to be "1". When the number of color pixels in the original becomes 255 or more, 
a signal (original judgement signal 105) representing that the target original is a color original becomes "1". 

as The original judgement value (color pixel threshold value) 6 Is calculated in the CPU 106 on the basis of the 
original size and the enlargement/reduction magnification and Is set In th counter 1406. 

When the read magnification is large, or when the original size is larg and the magnification is small, r 
when the riginal size is small, a threshold value 82 larger than th threshold value 61 is used. The threshold 
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value set in the DAT1 b changed in accordance with the original size and the copying magnification designated 
at the operation unit 110, thereby performing appropriate judgement The value 6 can be continuously or dis- 
cretely changed In accordance with the magnification. 

The number of pixels of the small area set in the DAT2 can be changed In accordance with the original 
size and the magnification. 

The Judgement of each small area of the original is output as the carry CARRY1 (1410) and Is latched by 

I "^^Tr^ 8,1 *" 8ma " areas ° f the °* hal b «™P»*ed. the Judgement result 

is output from an output terminal 1412. 

The original is Judged as a color or monochrome original by the above processing. 
(Fourteenth Embodiment) 

Fig. 23 is a block diagram for explaining the fourteenth embodiment The arrangement of Fig 20 is used 
to realize the calculations of equations (1) in the thirteenth embodiment However, in the fourteenth embodi- 
ment, an arrangement of Fig. 23 Is used to approximate the calculations of equations (1). When the coefficients 
of equations (1) are approximated by adding 1/(powerof 2) to each coefficient of equations (1) to obtain equ- 
ations (2) For example, the coefficient of 0.3 In equations (1) is approximated a* 0.25 + 0.0625. By adding 
data obtained by shifting the input data by two bits and data obtained by shifting the input data by four bits to 
easily calculate 0.3*R as follows: 
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^ U !L a j r !!! 8ement 3,80 ,ndudea addara 514. 515, 516. 517. 518, 521, 523. and 527. and subtracters 524. 525. 
and 526 The finally calculated data. Le., data Y. I. and Q appear at output terminals 528, 529, and 530, re^ 
spectrvely. 

A data flow will be described below. The Y, I, and Q data are similarly calculated, the calculation of the Y 
data is exemplified, and those of the data I and Q are omitted. As calculations of the (1/4 + 1/16) term of the 
equaoon (2). a 2-bit shift operation is performed by the 1/4 circuit 504, and a 4-bit shift operation is performed 
by the 1/16 circuit 507. The calculation results are added by the adder 517. As calculations of the (1/2 ♦ 1/16) 
H^? ^! l" PUt G data ,S Shmed by the 1/2 cta * 509 bv one bft . fl nd a 4-bit shift operation is performed by the 

cl ™ lt ^ 10 - 17,6 re3u,t and me output from the adder 517 are added by the adder*22. An output from the 
adder 522 is a sum of the R and G terms in the Y calculations of the equation (2). Data obtained by shifting 
the B input data 503 by three bits ts input to the adder 523. Finally, an output 528 from the adder 523 is given 
as Y in equation (2). 

In the embodiment described above, since there are provided: a means for separating component signals 
of me input colorslgnal into lightness and chromaticity signals; a means for generating a saturation signal from 
the chromaticity signal; a means for comparing the saturation signal with a threshold value a; a means for com- 
paring the saturation signal with a threshold value 0; a means for comparing the lightness signal with a threshold 
value r a means for incrementing a monochrome pixel count by one if the saturation signal is smaller than a 
as a result of comparison between a pixel of interest and the threshold value; a means for incrementing the 
monochrome pixel count by one when a pixel satisfying given conditions is included in neighboring pixels, and 
for incrementing a color pixel count by one when such a pixel Is not included in the neighboring pixels, the given 
conditions being such that the saturation signal is smaller than p as a result of comparison between the satu- 
ration .signal and 0 and that the lightness signal is smaller than y as a resultofcomparison between the Itahtness 
signal and y, the neighboring pixels being determined when the saturation signal Is qua! to or larger than a 
as a result of comparts n between the saturation signal fth pixel of interest and th thresh Id value; a means 
forsel ctingthen (ghboring pixels in accordance with a read magnification; a means for performing pixel judge- 
ment of unit lines of pixels and judging an original region f the unit pixels as a col r riginal region wh nthe 
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color pixel count is larger than the value 5 as a result of comparison between the color pixel count and the 
threshold value 5; a means for performing Judgement of all areas of the original in units of original areas; and 
a means forjudging the original as a color original when a color original region is present in the original areas, 
an original can be accurately judged even if the scanner precision is poor or the original has light color paper. 
5 Accurate Judgement can also be performed for an original having a colored underline. Accurate original judge- 
ment can be performed without causing color misregistration when the original is read In an enlargement/reduc- 
tion mode. As a result, processing can be performed in accordance with types of originals. Print quality can be 
improved, and the communication cost can be reduced. 

The image input means is not limited to the scanner, but can be replaced with an interface such as a host 
10 computer, a still video camera, and a video camera. 

The number of neighboring pixels is not limited to 8, and OR processing may be replaced with majority 
decision processing. 

The input Image may be separated into (L\ a*, b*), (L\ u*. v*), (Y, u, v) or (Y, Cr, Cb) in place of (Y. I, Q). 

is [Adjustment of Original Judgement) 

Primary Judgement forjudging whether an input pixel is a color or monochrome pixel is performed by com- 
paring saturation data (i.e., a distance 

Vl 2 I Q 2 

20 

from the origin of the IQ diagram; or a method using III + I O I may be used Instead) of the input Image with 
a pixel judgement threshold value o. 

Pigs. 33A and 33B win be described below. Fig. 33A shows an distribution of I and Q data upon reading 

25 of a monochrome original. When a pixel judgement threshold value Is set to be a1 , the I and Q data are con- 
centrated near the origin, so that the all the saturation values of the input image are smaller than a1 , and no 
color pixel is present Fig. 33B shows a distribution of I and Q data upon reading of a black character original 
with light red paper. When the pixel judgement threshold value Is set to be a1, some pixels have saturation 
data larger than a1, the presence of color pixels is judged. When the pixel judgement threshold value Is set to 

30 be a2, all the saturation values of the input pixel are smaller than a2, no color pixel is present In this manner, 
the number of pixels Judged as color pixels can be controlled by changing the pixel judgement threshold value. 
Therefore, a black character original with colored paper can be judged as a color or monochrome original. That 
Is, the judgement result can be controlled by the user In accordance with the magnitude of the pixel judgement 
threshold value. 

35 

(Fifteenth Embodiment) 

An original such as section paper having colored rules and an original having a red seal are apparently 
color originals. When a user wishes the system to transmit these originals as monochrome originals because 
40 they are frequently transmitted, data representing a color similar to the registered color is input and the color 
pixel Judgement signal is canceled. — . 

Fig. 37 Is a block diagram showing an arrangement of this embodiment This arrangement is roughly the 
same es that shown in Fig. 1 9, except that a registered color judgement unit 112 is added. 

45 (Registered Color Processing) 

Although an original such as section paper having colored rules and an original having a red seal are appa- 
rently color originals, a user wishes the system to transmit these originals as monochrome originals because 
they are frequently transmitted. Colors which should not be judged as color pixels such as blue as the color of 
so the section paper and red as the color of the red seal are registered beforehand. When data of this pixel is 
input color pixels are not counted. In this case, the original is judged as a monochrome pixel, so that the user's 
need is satisfied. 

More specifically, a color 1701 which should not be judged as a color pixel, as In Fig. 35, is painted on or 
adhered to a registration sheet and is read by a scanner 101 . For example, blue of the section paper is a color 
55 to be registered, a blue portion is adhered to a registration sheet 1702 and Is read by the scanner 101. The 
read data is converted into Y, I, and Q data which are then plotted n the IQ chromaticity diagram, as shown 
in Fig. 34. R presentative Y, I, and Q data are given as registered color data (e.g., Y = 50, 1 = -20, Q = 25). 

Upon this data registration, if input data is dose to the registered data, the corresponding original is n t 
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Judged as a color image but is judged as a monochrome image, thus performing registered color processing. 

c rf th^^^rrr Wta9 r B ^ b !i e ^ ,bod ' n detaB - ^ 36 b 8 blockdia 3^" lowing an arrangement 
ofthe registered color judgement unit 112. Input data are Y(1801). 1(1802). and Q(1803). A color wW oh should 
not be judged as a color pixel is performed as follows. A portion 1781 as a target color on the registration sheet 
1 702 in Flg^ 35 is scanned, an address controller 1807 outputs a signal to latches 1804 and 1 805 so as to store 
one pixel of the portion 1791 (severe! pixel data may be latched and averaged, end the average value may be 
registered as data). The latches 1804. 1805 and a latch 1808 latch data In accordance with a latch signal from 
toe address controller 1807. The Y, I. and Q data ofthe color to be registered can be registered. The registered 
data are then registered in registers 1808, 1809. and 1810 from a command from a CPU 111. Therefore, data 
RY, Rl. and RQ are registered In the registers 1808. 1809. end 1810, respectively. 

Processing executed upon an input of a color dose to that represented by the registered color data wfll be 
described below. The registered data RY is compared with input data Y by a comparator 181 1 . If the following 
condition is satisfied: 

Y > RY - 5 and Y < RY * 5 

the comparator 1811 outputs *1* data. Otherwise, the comparator 1811 outputs *0" data. In other words theY 
value te judged whether to fall within the range of ±5 of the value RY of the lightness (luminance) ofthe registered 
color data. Similarly, a comparator 1812 Judges whether an input I value fails within the range of ±5 of the 
chromatlcity value Rl of the registered color data, and a comparator 181 3 judges whether an input Q value fails 
within the range of ±5 of the chromaticity value RQ ofthe registered color data. An AND gate 1814 cutouts "1" 
data when all the outputs from the comparators 1811, 1812, and 1813 are "1" data. That is, when input data 
is relatively close to registered data, the AND gate 1814 outputs "1" data. A selector 1816 selects a signal In 
accordance with an output result of the AND gate 1814. When the output result represents T data, the AND 
gate 1814 selects the content of the register 1816. Otherwise, the AND gate 1814 outputs the input data YIQ 
without any modifications. When the contents of the register 1815 are Y «= 0, 1 = 0, and Q » 0, and the Input 
data represents a value close to the registered color data, Y. I, and Q data of the black pixel are output The 
output results of the registered color judgement unit are Y<1817), 1(1818), and Q(1819). 

According to this embodiment, since there are provided: a means for separating component signals ofthe 
input color signal into lightness and chromaticity signals; a means for generating a saturation signal from the 
chromaticity signal; a means for comparing the saturation signal with a threshold value a; a means for com- 
paring the saturation signal with a threshold value 0; a means for comparing the lightness signal with a threshold 
value y; a means for registering a specific color; a means for incrementing a monochrome pixel count by one 
if the saturation signal is smaller than a as a result of comparison between a pixel of interest and the threshold 
value; a means for incrementing the monochrome pixel count by one when a pixel satisfying given conditions 
fe included in neighboring pixels, and for incrementing a color pixel count by one when such a pixel is not 
included in the neighboring pixels, the given conditions being such that the saturation signal Is smaller than p 
as a result of comparison between the saturation signal and p and that the lightness signal is smaller than v as 
a result of comparison between the lightness signal and y. the neighboring pixels being determined when the 
saturation signal is equal to or larger than a as a result of comparison between the saturation signal ofthe pixel 
of interest and the threshold value; a means for selecting the neighboring pixels in accordance with a read mag- 
nification; a means for incrementing the monochrome pixel count when the input pixel represents the specific 
colon a means for performing pixel judgement of a predetermined unit of pixels amrjudging that an original 
area of the unit of pixels is a color original area when the color pixel count is larger than 6 as a result of com- 
parison between the color pixel count and the threshold value 8; a means for performing judgement in units of 
original areas throughout the an the areas ofthe original; a means for changing the threshold value 8 in accord- 
ance with an original size and a read enlargement/reduction magnification; a means for changing the threshold 
value a; and a means forjudging that the original is a color original when a color original area is present m the 
original areas, an original can be accurately judged even If the scanner precision is poor or the original has 
light color paper. Accurate Judgement can also be performed for an original having a colored underline. Accurate 
original judgement can be performed without causing color misregistration when the original is read in an 
enlargement/reduction mode. Accurate original judgement can also be performed when the original size is 
changed or the enlargement/reduction magnification is changed. In addition, the judgement result can be adjus- 
ted In accordance with the user's will. When a color not to be judged as a color pixel is registered, an original 
which is supposed to be judged as a color original can be automatically judged as a monochrome original. More 
specifically, blue of section paper and red of a red seal are registered, monochrome originals with these colors 
are not judged as color originals but as monochrome originals. 

Processing can b performed in accordanc with types of originals. Print quality can be improved, and the 
communication cost can b reduced. 

Colors to be registered may be colors of colored regenerated paper in addition to blue of section paper 
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and red of a red seat. 

A plurality of colore can be registered. 

The colore to be registered need not be input from a scanner. A plurality of registration color data may be 
stored In a ROM In advance, and a desired registration color may be selected at an operation unit 

The image input means is not limited to the scanner, but can be replaced with an Interface such as a host 
computer, a still video camera, and a video camera. 

The number of neighboring pixels is not limited to 8, and OR processing may be replaced with majority 
decision processing. 

The Input image may be separated Into (L*. a*, b*), (L*, u*. v*), or (Y. u. v) in place of (Y. I f Q). 

(Original Having Pixel of Intermediate Saturation as Low Saturation) 

A pixel Included in a hatched portion In Fig. 42 is Judged as a monochrome pixel because it has a saturation 
value smaller than the threshold value ou When a black character original wfth an under color portion having 
a low saturation level (e.g., regenerated paper) is taken into consideration, and when the saturation value of 
the under color portion is smaller than the threshold value a, this original is Judged as a monochrome original. 
Otherwise, the original Is judged as a color original. The number of pixels belonging to the hatched portion is 
relatively increased in a photographic original having a low saturation. In this case, since the saturation value 
is smaller than the threshold value a, the original Is judged as a monochrome original. In an original having an 
under color portion of a low saturation level, since the number of pixels included in the hatched portion is very 
larger than that in the photographic original, control is performed to Judge the original as a monochrome original 
when the number of pixels having intermediate saturation values la larger than the predetermined value p. 
Otherwise, the original la judged as a color original. 

(Sixteenth Embodiment) 

A flow chart of this processing Is shown In Fig. 41 . The processing is divided into pixel judgement processing 
(S801 to S604), pixel correction processing (S605 to S61 1), and original Judgement processing (S612 to S61 5). 
The pixel judgement processing is processing forjudging whether a pixel of Interest Is a color or monochrome 
pixel. The original judgement processing is processing forjudging whether the original as a whole Is a color or 
monochrome original. The details of the algorithm wOl be described with reference to the flow chart below. 

<Pixei Judgement Processing> 

Color pixel Judgement processing will be described first Color pixel judgement is performed in steps S601 
to S604 to judge whether an input pixel is a color or monochrome pixel in units of pixels. 

<3) Color Space Conversion Processing 

Color Space conversion processing is performed in step S601 . More specifically, the data normalized into 
NTSC-RGB are converted into a luminance signal Y and chrominance signals I andQ in accordance with equ- 
ations (1) below: 
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©Distance Calculation 

In order to generate saturation information from the i and Q data, a distance calculation unit calculates 

in steps S602 and S606. This distance is a distance between the origin and the target color on the 1Q chromati- 
city diagram. When this value is large, the saturation value is large accordingly. Th corresponding pixel has 
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a higher probability as a color pixel. 
©Saturation Comparison Unit 

The saturation value of the pixel of interest is compared with the threshold value In step S603. As shown 
in Fig. 28A, the pixel C of interest is part of a character or an under color portion (limited to white), it has a low 
saturation level. The flow advances to step S604 to sat isfy condition 

if I 2 + Q 2 < «, 



and a black pixel count BPLX is Incremented by one. The flow returns to step S602, and the next pixel Is read 
to repeat the above processing. 

When the pixel of interest Is assumed to be located as a color pixel as shown In Fig. 28B, it has a high 
saturation level, and the flow advanc es to step S6 05 without satisfying condition 

/l 2 + Q 2 < C4. 



® Pixel Correction Processing 

Steps S805 to S61 1 correspond to the pixel correction processing unit These steps are provided to correct 
a judgement error as a color pixel due to blurring of a black character caused by color misregistration of the 
sensor even If the saturation comparison unit corresponding to step S603 Judges that the input pixel is a color 
pixel. The pixel correction unit will be described below. 

In step S805, eight neighboring pixels Si to Se of the pixel C of Interest in Rg. 23 are Input one by one. In 
step S606, RGB-+Y1Q conversion is performed by color space conversion (the same as in steps S601) 

Saturation information 

is calculated in step S607 (the same as in steps S602). Saturation values 

/ft? 

of the neighboring pixels and the luminance Y are compared with the threshold values in step S608. For 
example, when the neighboring pixel Si is a character portion, the saturation and luminance values of this pixel 
are low, it satisfies conditions 



^I 2 + Q 2 < 



and Y < y. As a result, although the pixel C is judged as a color pixel in pixel judgement processing, this mis- 
judgement is caused by color misregistration of the sensor. This pixel must be judged as a black pixel, and the 
flow advances to step S609. The black pixel count BPLX is incremented by one. Since the neighboring pixel 
So does not satisfy conditions 

/FT? < 0 

and Y < y, the pixel S 6 is determined not to be a black pixel. In this case, the flow advances to step S61 0. It is 
judged in step S610 whether ail the eight neighboring pixels are input Processing in steps S605 to S610 to 
judge whether a black pixel is included in the eight neig hboring pixels is repeated for all the eight pixels In S601 
to S609 of the pixel of interest If at least one black pixel is included in the eight neighboring pixels, the pixel 
C of interest Is judged as a black pixel, and the flow advances to step S609. If no black pixel is Included In the 
eight neighboring pixels, the pixel C of interest is not judged as a color pixel by color misregistration, but is a 
real color pixel. In this case, the flow advances to step S61 1, and th color pixel count CPLX is incremented 
by one. 
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<Cotor/Monochrorne Original Judgement 

The pixel judgement (S601 to S611) described above is performed for ail the pixels of the original to cal- 
culate a ratio of the color pixel count CPLX to the monochrome pbcel count BPLX When condition CPLX > 5 
5 Is satisfied in step S61 3, the target original Is judged as a color original. Otherwise, the target original is judged 
as a monochrome original. 

The above flow chart shows processing executed by computer software. A circuit arrangement for perform- 
ing the above processing will be described with reference to Fig. 38. 

When an original is placed on a scanner 101 consisting of a CCD device and scanned, normalized R, G, 
10 and B data complying with the NTSC system are output R, G, and B data output from the scanner 101 are 
converted by a YIQ conversion unit 101 Into a lightness (luminance) signal Y and chrominance (chromaticity } 
signals I and Q. A pbcel judgement unit 103 judges whether an input pbcel Is a monochrome (small saturation 
value) or color pbcel. An original judgement unit 104 accumulates the judgement results in units of pixels and 
calculates a ratio of the number of color pixels to the total number of pixels. The original judgement unit 104 
is outputs an original judgement signal 105 representing that the original is a color or monochrome original in 
accordance with the calculated ratio. This circuit arrangement also includes an image processing unit 106, a 
display 107 for performing an image display, a fecsimBe transmission una 108 for performing image transmis- 
sion, a printer 109 for reproducing an image on a recording medium, an intermediate saturation pbcel count unit 
110, and a CPU 111. The image processing unit 106 perform different processing operations for the monoc- 
20 hrome and color originals In accordance with the original judgement signal 105. 

For example, en image signal sent to the facsimile transmission unit 1 08 is subjected to compression coding 
so as to store it in the form of R, G, and B signals for a color original, and is subjected to density (luminance) 
signal conversion to perform compression coding such as MH, MR, or MMR coding for a monochrome original. 

When an image signal of a color original is to be sent to the printer 1 09, predetermined processing oper- 
as ations such as logarithmic conversion, UCR, and masking are performed for the R, G, and B signals, thereby 
performing image processing so as to obtain frame sequential Y, M, C, and K signals. However, an image signal 
of a monochrome original Is processed to obtain only a K (black) signal, thereby performing printing in only 
black. 

The printer may be a color printer such as a laser beam printer, an ink-jet printer, a thermal printer, or a 
30 dot printer. 

Fig. 39 is a view showing the pbcel judgement unit Y, I, and Q data are input to input terminals 1301, 1302, 
and 1 303, respectively. The data I Is squared by a multiplier 1 31 0, and the data Q is also squared by a multiplier 
1311. The products P and Q 2 from the multipliers 1310 and 1311 are added by an adder 1312. A calculation 
of 

35 /FT? 



is performed with reference to a table. For example, an input to a ROM 1313 is "2", the second address of the 
ROM is accessed, and the corresponding data "1.414" is output The output value 

40 /I 1 - Q l 

from the ROM 1313 is input to comparators 1305 and 1306. A threshold value p is set in e register 1308, and 
the threshold value a is set in a register 1309. The comparator 1305 compares the threshold value p with 

and outputs "1" data if condition p < 



^l 2 + Q 2 . 

50 

Otherwise, the comparator 1305 outputs "0" data. The comparator 1308 compares the threshold value a with 

/l 2 + Q 2 

55 

and outputs "1" data if condition a < 
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I + Q . 

Otherwise, the comparator 1306 outputs t)" data. An output result of the compaiators 1308 is called a primary 
judgement result J 

^ m ^ r vlm htl l e ^ (, T ,na T e) 8lana1, 8 thresh0ld «*"T b sat in a register 1307. and a comparator 1304 
comparesY withy. If Y<y, then the comparator 1304 outputs "1" data. Otherwise, the comparator 1304 outputs 
y «»• a"*"* from the comparators 1304 and 1305 are logically ANDed by an AND gate 1314. More speci- 
fically, when a lightness (luminance) Is low, and saturation is also low. the AND gate 1314 outputs '1- data 
Otherwise, the AND gate 1314 outputs -0- data. An output result of the AND gate 1314 la called a secondary 
T ou * utfrom * eAND S 818 ia Inputto a flip-flop (to be referred to as an FF heralnafS 
1318 and a line memory 1315. An output from the line memory 1314 is inputto line memories 1316 and 1312. 
A pixel delayed by one line is Input to an FF 1321 and a pixel delayed by two lines Is Input to an FF 1324. The 
Z J1k I* 8t0r8 OUtpUt re8ulte frum the AND gate 1314 In synchronism with pM docks. At a given 
moment, when die secondary judgement result of the pixel of Interest is stored In the FF 1322, the secondary 
Judgement results of the eight neighboring pixels are stored in the FFs 1318. 1318, 1320, 1321, 1323. 132* 
-Zl ?f^ e8pecUvely - 1718 secondary judgement results of these eight pixels am logically ORed by OR 
^ S 133 °' rf I 3 f II nd ^ Even if one of the eight neighboring pLla ha. the ^S^^ZZ 
m r"°L2- a "°,T tfr0fnan OR9ate 1332 18 In other words, even if one of the eight nelgnborlng 

^rest's Judged 88 8 bteok P^.tt» OR gate 1332 outputs -1" data. An output from this 
?fnf rJJ^L 8 Pixel .^ ecti °" re8tjlt 708 <«tout (primary judgement result) from the comparator 
„°f 1 i' n f ut '' n8 memory 1317 and is delayed by one line The delayed data is supplied to FFs 1327 and 
1328. That «. the FFs 1327 and 1328 atom the primary and secondary judgement results of the same pixel. 

Finally, the pixel correction result and the primary judgement result are logically NORed by a NOR gate. 
When toe input pixel is judged as a color pixel, a color pixel judgement signal 1334 Is set at logic 1". However 
when the input pixel is judged as a monochrome pixel, the signal 1334 Is set at logic "V 

*S'J?nl$ , bl ^ dia9 , rarn ° f ^! , 0ri9,naI judgement unlt up-counter 1406 counts up data from Initial 
count data DAT input to its input 1403 In response to a pixel clock input to its input 1402 and a color pixel judge- 
rr»ntsfenalmputtoitelnput1401.ThecountHip enable period is definedaaapertodof the colorpbtelW«nent 
signal of logic "1". As a result, the color pixel judgement pulses are counted 

nJ^l^H^!^ ? atUra ^° n pbc8 !? u " t unit 110 ,n 38 «""*» «» ™»nber of input pixels having inter- 
mediate saturation values. More specifically, referring to F ig. 42, when a pixel satisfying conditions ae saturation 

.I 2 + Q 2 > e 

and saturation 

/l 2 + Q l < a 

is input, the count unit 1 10 counts the number of input pixels having intermediate saturation values. An original 
Judgement unit 104 compares a color pixel count with the threshold value «. ACPU 111 judges the input original 
^^T^^f. * < ?" di0on (°° lor P"* 81 «>ure) > 8 la satisfied. However, if condition (color pixel count) s« is 
satefied. the CPU 1 1 1 Judges the input original ae a monochrome original. The CPU 1 1 1 changes the threshold 
value 6 in accordance with the count of the intermediate saturation pixel count unit That is, the intermediate 
saturation pixel count is larger than the predetermined value B. the threshold value 6 Is Increased to cause the 
drcuitarrangement to tend to judge the input original as a monochrome original. However, if the intermediate 
saturation pixel count is small, the threshold value 6 is decreased to cause the apparatus to tend to judge the 
nput original as a color original. The set threshold value la set In a DAT 1403. By changing the judgement criter- 
ion for monochrome/color judgement of the original Is changed In accordance with the number of pixels having 
intermediate saturation values between chromatic and achromatic values, thereby obtaining a desired judge- 
ment result * • 

The original can be judged as a color or monochrome original by the above processing. 
(Seventeenth Embodiment) 

F(g.23isaviewfbrexpla!n!ngth seventeenth embodiment in the sixteenth embodiment th arrangement 
shown In Fig. 20 is used to realiz the calculations represented by equations (1). In the seventeenth embodi- 

26 



EP 0 448 330 A1 



ment, however, the calculations of equations (1 ) are approximated by the arrangement shown In Fig . 23. When 
coefficients of equations (1) are approximated by adding 1 /(power of 2) to each coefficient to obtain equations 
(2). For example, the coefficient of 0.3 in equation (1) Is approximated as 0.25 + 0.0625. With this approximation, 
data obtained by shifting the Input data by two bits is added to data obtained by shifting the Input by four bits 
to facBitate a calculation of 0.3*R. 

According to this embodiment, since there are provided: a means for separating component signals of the 
input color signal into lightness and chromaticity signals; a means for generating a saturation signal from the 
chromatictty signal; a means for comparing the saturation signal with a threshold value a; a means for com- 
paring the saturation signal with a threshold value p; a means for comparing the lightness signal with a threshold 
value r. a means for counting input signals having intermediate saturation values; a means for incrementing a 
monochrome pixel count by one if the saturation signal Is smaller than a as a result of comparison between a 
pixel of interest and the threshold value; a means for incrementing the monochrome pixel count by one when 
a pixel satisfying given conditions is included in neighboring pixels, and for incrementing a color pixel count by 
one when such a pixel is not Included in the neighboring pixels, the given conditions being such that the satu- 
ration signal is smaller than 0 as a result of comparison between the saturation signal and p and that the light- 
ness signal Is smaller than y as a result of comparison between the lightness signal and y, the neighboring pixels 
being determined when the saturation signal is equal to or larger than a as a result of comparison between the 
saturation signal of the pixel of interest and the threshold value; a means for changing the threshold value 6 in 
accordance with a total number of input signals having the intermediate saturation values, a means for com- 
paring the color pixel count with the threshold value 6; and a means forjudging an input original as a color origi- 
nal when the color pixel count Is larger than the threshold value 5 as a result of comparison between the color 
pixel count and the threshold value 5, an original can be accurately judged even if the scanner precision Is poor 
or the original has light color paper. Even if a photographic original having a low saturation level can be accu- 
rately judged without any Judgement errors. Therefore, processing can be performed In accordance with types 
of originals. Print quality can be improved, and the communication cost can be reduced. 

The image input means is not limited to the scanner, but can be replaced with an Interface such as a host 
computer, a still video camera, and a video camera. 

The number of neighboring pixels is not limited to 8, and OR processing may be replaced with majority 
decision processing. 

The input image may be separated into (L*. a*, b"), (L*, u*, v*), (Y. u, v) or (Y, Cr, Cb) in place of (Y, I, Q). 
The present invention is not limited to the particular embodiments described above. Various changes and 
modifications may be made within the scope of the appended claims. 



1. A method of processing an image, comprising the steps of converting inpufcolorimage data into chromati- 



ctty data and lightness data and performing monochrome/color judgement Tdt^ne-frame input color image 



data in accordance with the chromaticity data and the lightness data. 

2. A method of processing an Image, comprising the step of performing monochrome/color judgement of input 
color image data in accordance with a frequency distribution of saturation information obtained from the 
input color imaogdajajnjini te of pixels. 

3. A method of processing an Image, comprising the steps of: 

a) extracting chromaticity data from Input color image data; and 

b) performing monochrome/color judgement of the Input color Image data in accordance with saturation 
information data obtained from the chromaticity data. 

4. A method according to claims 1 , 2 and 3, wherein the input color image data comprises three primary color 



5. A method according to claim 4, wherein the three primary color components are red, green, and blue, re- 



6. A method according to claims 1, 2 and 3 further comprising the step of processing the input color image 
data in accordance with the m nochrome/coi r Judgement 



Claims 




components. 



spectively. 
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7. A method according to claim 1. wherein the step of converting the input color Image data comprises the 
step of performing color space conversion. 

8. A method according to ciaim 7, wherein the color space conversion comprises conversion from an RGB 
space to an L*a*b* space. 

9. A method according to claims 2 and 3, further comprising the step of normalizing the saturation Information 
in units of pixels. 

10. A method according to claims 2 and 3, wherein the frequency distribution is detected by using a RAM. 

11. An image processing apparatus comprising: 

a) means for converting an Input color signal into a lightness signal and a crtromatictty signal; 

b) judging means for performing chromatic/achromatic Judgement In accordance with the chromatid^ 
signal; and 

c) control means for excluding a predetermined color from Judgement objects. 

12. An image processing apparatus comprising: 

a) means for converting an Input color signal Into a lightness signal and a chromatfcHy signal; 

b) Judging means for performing chromatic/achromatic Judgement In accordance with the chromaticitv 
signal; and 

c) means for correcting a judgement result of said Judging means in accordance with the lightness signal 
and the chnomatfcity signal. 

13. A image processing apparatus comprising: 

a) means for separating an Input color signal into a lightness signal and a chromatfcHy signal; and 

b) Judging means for performing chromatic/achromatic Judgement of each predetermined area in 
accordance with the chromaticity signal. 

14. An image processing apparatus comprising: 

a) Judging means for performing chromatte/achromatte judgement of an Input color signal; 

b) processing means for changing a magnification of an Image represented by the input color signal; 
and 

c) control means for changing a judgement parameter of said judging means In accordance with the 
magnification. 

15. An image processing apparatus comprising: 

a) judging means for performing chromatic/achromatic Judgement of an input color signal; and 

b) control means for controlling a judgement reference of said Judging means In accordance with a num- 
ber of intermediate saturation pixels Included In the input coior signal. 

16. An Image processing apparatus comprising: 

a) means for outputting color Judgement signals in units of pixels In accordance with a maximum value 
of absolute values |A-B|,|B-C|,and|C-A| representing differences between trfstimulus values 
A, B ( and C representing colors; and 

b) means for outputting a color image judgement signal in accordance with a count of the color judge- 
ment signals. 

17. An apparatus according to claims 11,12, 13. 14 and 15, further comprising means for performing monoc- 
hrome/color judgement of an original represented by the input color signal, in accordance with the judge- 
ment result 

18. An apparatus according to claims 11, 12, 13, Hand 15, further comprising means for processing the Input 
color signal in accordance with the judgement result 

19. An apparatus according to claims 11, 13, 14 and 15, further comprising means for correcting a judg ment 
result of said judging means with reference to neighboring pixels. 
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20. An apparatus according to claim 11, further comprising input means for Inputting the predetermined color. 

21. An apparatus according to claim 12, wherein said correcting means performs correction with reference to 
neighboring pixels. 

6 

22. An apparatus according to claims 12 and 13, wherein the input color signal comprises three primary color 
components. 

23. An apparatus according to claim 22, wherein the three primary color components are red, green, and blue, 
10 respectively. 

24. An apparatus according to claims 12 and 13, wherein the chromatfcity signal is a signal represented by a 
two-dimensional orthogonal co-ordinate system. 

is 25. An apparatus according to claims 12 and 13, wherein the step of converting the input color image data 
comprises the step of performing color space conversion. 

26. An apparatus according to claim 13, wherein said means for separating the Input color image comprises 
means for performing color space conversion. 

20 

27. A method of analyzing an image area comprising the steps of: 

a) analyzing a plurality of constituent sub-areas, to derive color related data therefrom; and 

b) analyzing said color related data to derive a color related criterion for the area. 

25 28. A method according to claim 27 In which the sub-areas comprise pixels. 

29. A method according to claim 27 or claim 28 comprising designating the image area as either colored or 
monochromatic. 

30 30. A method according to any one of claims 27 to 29 comprising labelling each sub-area in dependence upon 
a threshold, and counting the numbers of sub-areas exhibiting each different label. 

31. A method of deriving the color of an Image area comprising analyzing individual pixels or groups of pixels 
to derive pixel/group color labels, and counting the number of such labels. 

35 

32. A method of designating the color of an image area in which character underlining^ are ignored. 

33. A method of designating an original document image as being either chromatic or monochromatic, charac- 
terized in that the background document color is ignored. 

40 

34. A method of analyzing a pixel color by taking into account the colors of surrounding pixels, characterized 
In that the surrounding pixels are selected in dependence upon an image size criterion. 

35. A method according to claims 1 or 3, wherein the chromatitity data Is data represented by a two-dlmen- 
45 sional orthogonal co-ordinate system. 
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